503038-A-01-US (CHOU) 
Serial No. 10/814,081 
Ryan, Mason & Lewis, LLP; J. B. Ryan (516) 759-2722 



1/5 



FIG. 1 
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FIG. 2 
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FIG. 3 



Set up initial word class mapping 

Compute the mapping perplexity on the training corpus 
Do until some stopping criterion is met 
Do for each word w in vocabulary W 
Remove w from class g w 

Do for all existing classes g: 

Compute perplexity as if w were moved to g 
end-do-loop 
Assign it; to the class with the lowest perplexity 
end-do-loop 
end-do-loop 

Exit 
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FIG. 5 

APPEND: APPEND ONE CORPUS TO ANOTHER 
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FIG. 6 

GIVEN A PARAMETER p: 

1. CALCULATE THE IG VALUE OF EACH TERM 

2. SORT THE TERMS BY THEIR IG VALUES INTO 
DESCENDING ORDER 

3. SET THE THRESHOLD t TO THE IG VALUE AT 
TOP p PERCENTILE OF SORTED TERMS 

4. SELECT TERMS WITH IG VALUE > t 
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FIG. 7 
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